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Simple dynamical systems - with a small number of degrees of freedom - can behave in a complex 
manner due to the presence of chaos. Such systems are most often (idealized) limiting cases of 
more realistic situations. Isolating a small number of dynamical degrees of freedom in a realistically 
coupled system generically yields reduced equations with terms that can have a stochastic interpre- 
tation. In situations where both noise and chaos can potentially exist, it is not immediately obvious 
how Lyapunov exponents, key to characterizing chaos, should be properly defined. In this paper, 
we show how to do this in a class of well-defined noise-driven dynamical systems, derived from an 
underlying Hamiltonian model. 
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I. INTRODUCTION 

The characterization of deterministic chaos, particu- 
larly in Hamiltonian systems, is now well-established, 
and essentially consists of computing and understanding 
the Lyapunov spectrum of the dynamical system [l|, Q ■ 
In the vast majority of experiments, however, Hamilto- 
nian systems are only an idealization, and it is not always 
clear - given a phenomenological description - what role 
dynamical chaos might actually play in the physics, let 
alone be certain about how to characterize it. 

A somewhat similar situation also exists in the model- 
ing of complex systems, where often one wishes to sepa- 
rate 'slow' and 'fast' degrees of freedom in such a way that 
the fast degrees of freedom can be viewed as a stochastic 
forcing term, often called 'noise' As emphasized 

by Zwanzig @, a key problem is that depending on the 
nature of the approximations one chooses to make, the re- 
sulting noise terms in the stochastic dynamical equations 
(Langevin equations), can end up being very different. 

It is therefore easy to appreciate that when both noise 
and chaos are combined, the situation is doubly compli- 
cated. Nevertheless, such situations are not only com- 
mon, but also of significant interest in many applica- 
tions. These include such diverse areas as noise-induced 
chaos , ecology [ll| , galactic dynamics [l2| , and the 

quantum-classical transition [l3|, E5 . 

The purpose of this paper is to consider the interac- 
tion of noise and chaos in a dynamical model where the 
basic physical and approximation-related issues can be 
separately understood. This will not only help clarify 
the nature of some previous disagreements in the litera- 
ture but also provide a more well-founded notion of the 
(maximal) Lyapunov exponent (LE) in noisy systems, at 
least within a specific, well-defined, context. 

The overall picture adopted here assumes the existence 
of a complex Hamltonian system, where one focuses on a 
small set of relevant degrees of freedom, deriving effective 



equations for their evolution. Because the full system is 
specified, issues of how to define chaos and noise, and 
their interaction, are easier to clarify. Discussions of the 
possible difficulties and choices of definitions in the con- 
text of a more phenomenological setting can be found in 
Refs. [IE Ell- 
in this paper, we consider Hamiltonian models for 
Brownian motion as the relevant archetype. In these 
models, a dynamical system is coupled to a heat bath, 
modeled by an ensemble of non-interacting harmonic os- 
cillators. An analogous model was first described by Ru- 
bin [It}, and the basic notion was later elucidated by a 
number of authors, including Ford, Kac, and Mazur [18j . 
Zwanzig [l9j . and, as better known in the quantum con- 
text, by Caldeira and Leggett [20j|. Although these mod- 
els are by no means completely general, they provide an 
excellent basis for addressing conceptual problems. 

In adopting this view we nevertheless wish to be clear 
in what circumstances analyses such as ours are meant 
to apply: Our results will not be directly relevant to 
heuristic models of complex systems that are not based 
on a first-principles analysis, nor are they intended to 
apply in the strong noise limit, where the effects of chaos 
can be washed out by the effects of the noise drive. 

As a consequence of the self-consistent nature of 
our analysis, the (nonequilibrium) fluctuation-dissipation 
theorem will ensure that system trajectories explore a 
unique distribution at late times, that defined by ther- 
mal equilibrium, f eq ~ exp{— (3H}, where H is the sys- 
tem Hamiltonian and j3 = l/fc^T is proportional to the 
inverse temperature. Thus the LE we consider is av- 
eraged over the canonical distribution, in contrast to a 
constant energy hypersurface in the non-noisy case, when 
the system is not coupled to a heat bath. The lower 
the temperature of the heat bath, the smaller the noise 
strength, and the smaller the energy fluctuations. In the 
singular limit of vanishing coupling to the heat bath, any 
phase space distribution that is a function of the system 
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Hamiltonian is invariant, and there is no longer the no- 
tion of a single unique distribution that can be used to 
study trajectories in the late-time limit. However, in this 
case, as a consequence of the ergodic theorem, constant 
energy hypersurfaces are fully explored by long-time tra- 
jectories, and, as is familiar, the LEs become functions 
of the energy. 

At this point it is important to distinguish between 
'external' and 'internal' noise. The case of external noise 
arises when the noise drive is unaffected by the system 
evolution, while internal noise refers to the fluctuations 
of a complex system coupling to its own slow modes; in 
this case, the noise may be affected by the system evo- 
lution, both in terms of its intrinsic statistical properties 
and in terms of the particular noise realization associated 
with a background trajectory (even if the statistics are 
unaffected). We discuss both of these cases below. 

Finally, it is important to consider various limits, such 
as the overdamped (strong-coupling) limit and the weak- 
noise (low temperature) limit. Note that these limits 
are independent, but can define physical timescales rel- 
evant to our analysis. In the examples considered here, 
the system relaxation time is independent of tempera- 
ture or noise strength and depends only on the damping 
coefficient, in turn set by the inverse of the system-bath 
coupling strength. The convergence timescales for the 
LE are typically very long, significantly longer than typi- 
cal thermal relaxation timescales, consequently the initial 
phase of the evolution is unimportant. Thus, for our pur- 
poses, the relevant dynamics of the system is that related 
to the exploration of a thermal equilibrium state as men- 
tioned above. In the cases we study, the equilibrium is 
established by interaction with a heat bath (equilibrium 
for a canonical ensemble, as given by the static solution 
of a Fokkcr-Planck equation), satisfying the fluctuation- 
dissipation relation. Energy fluctuations are bounded as 
long as the system potential is asymptotically confining. 
For the most part we will consider the low noise case but 
discuss both the weak and strong coupling limits. The 
strong coupling limit is singular and care is needed with 
the analysis in order to avoid incorrect results. 

The rest of the paper is organized as follows. We be- 
gin in Section [TT] with a short review of the derivation of 
the relevant Langevin equations, emphasizing issues that 
will be taken up in later sections. We will then consider 
the case of the Langevin equation with the noise treated 
entirely as an external perturbation (Section [TTTJ) , define 
the LE, and proceed to show - without making the over- 
damped approximation - that when the system is one- 
dimensional, the addition of noise cannot lead to a posi- 
tive LE. This changes the result of Ref. [2l| who claimed 
that in this case, the LE could be positive (noise-induced 
chaos) or negative. Extending to higher dimensions, we 
show that in this case, the LE can indeed be positive or 
negative, in contrast to Ref. (22}, who claimed that the 
LE is always negative. Having completed the analysis 
for the external noise case, we then extend our analysis 
to systems with internal noise (Section IIV|) . Examples of 



numerical results that agree with our conclusions can be 
found in Refs. [l2l - fl4l ] . Finally, we discuss some open 
questions and possible future research directions related 
to chaos and noise in our conclusion. 

For notational consistency we will write all our vectors 
in boldface and all our matrices in scripts, and the com- 
ponents of vectors and matrices will be in normal font, 
i.e. v\ is the first component of the vector v and Mn is 
the top- left entry of the matrix Ai. 



II. INDEPENDENT OSCILLATOR MODEL FOR 
BROWNIAN MOTION 

As discussed in the Introduction, for the most part, 
stochastic differential equations appear in the modeling 
of physical systems primarily in a phenomenological con- 
text. Because of the uncontrolled approximations inher- 
ent in how these equations are often written down, it 
is not obviously apparent how to think about the in- 
teraction of noise and chaos in a systematic fashion, as 
both of these can be very sensitive to choices made in 
the modeling process, which may or may not be entirely 
self-consistent, or even physically correct. 

There are, nevertheless, several examples of areas 
where stochastic equations can be derived in a more 
or less controlled fashion (based on assumptions such 
as timescale separation), starting from an initial Hamil- 
tonian formulation. These include the (multiplicative 
noise) Langevin description of the Landau equation in 
plasma physics (23| , the description of Brownian motion 
based on a Hamiltonian system coupled to a large set 
of independent oscillators [l7l - [2Cl |. and, more generally, 
equations derived using the Mori-Zwanzig projection op- 
erator technique |24l - l2q |. 

To fix ideas, we present here a short derivation of Brow- 
nian motion using the independent oscillator model, fol- 
lowing Zwanzig 0. The full (positive-definite) Hamilto- 
nian, of a system interacting with a "bath" of oscillators 
is taken to be: 
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+ u 2 Aqj - aj(x)Y 



(1) 



where the system coordinates are (x,p) and the smooth 
functions aj(x) describe possibly nonlinear couplings of 
the system to the oscillators. Note that there is an as- 
sumption here that no degree of freedom of the bath is 
strongly perturbed by the system of interest; this justifies 
treating the qj effectively in a linearized approximation. 
The distribution of the frequencies, Uj, as well as the 
choice of the function a,j{x) controls the noise memory 
as discussed below. 

To simplify matters, we first consider a linear coupling 
to the oscillators, i.e., we set a,j(x) = (jj/u^x. Writ- 
ing down Hamilton's equations starting from Eq. (TTJ, 
formally solving the equations of motion for the oscil- 
lators treating jjx(t) as time-dependent external force, 
and substituting this solution into the equations for the 
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system variables, we obtain the formal Langevin equa- 
tion, 

p{t) = -V'(x) - / K N (t - s)p(s) + F N {t), (2) 



where the damping kernel is 



K^{t — s) = -^2 cosujj(t — s) 



(3) 



and the 'noise' force is 



F N {t) 



E 



7i 



Qi(0) 



x(0) 



COS Uljt 



(4) 



The damping kernel, or memory function, is in general 
not Markovian and is determined entirely by the cou- 
pling constants and oscillator frequencies. In contrast, 
F^(t) is determined entirely by the initial conditions. If 
these are known precisely then Fn (t) is not a noise term. 
However, if the initial conditions are prescribed in a sta- 
tistical manner, then the situation is different. Suppose 
that the statistical ensemble of initial conditions is such 
that the first moments vanish, i.e., 



(ft(0)>o = 0, 

7j 



(<Z,(0)-^*(0))o 



(5) 



then, it is immediate from Eq. ((4]) that (Fiy(t))o = 0. 
Now, if the second moments of the initial ensemble are, 

(p i (0)p fc (0))o = k B Td jk , 

([ ? .(0)-^(0)]fe(0)-^(0)]) = ^5 jk , (6) 
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then, 



(F N (t)F N (t')) = k B TK N (t - t'), 



(7) 



which is a generalized fluctuation-dissipation theorem. 
An initial ensemble that satisfies these conditions is one 
in which the heat bath is in thermal equilibrium with 
respect to the system, whereas the system variables are 
allowed to have an arbitrary distribution: 



/(* = 0) ~ ff"{x,p) eM-PH ba th), 



(8) 



where Flbath represents the Hamiltonian of the oscillators 
and the system-bath couplings, i.e., the term containing 
the summation in Eq. (fTJ). In general, the noise is not 
Markovian; however, in the special limiting case of a large 
number of oscillators, N, following a Debye distribution 
(i.e., the spectral distribution g(co) — 3uj 2 /u' 2 D for u> < 
wc, and g{uj) = for uj > w_d), and assuming that the 



system momentum varies slowly on timescales set by the 
inverse Debye cutoff t b = 1/wd, the kernel K]y(t—s) can 
be approximated as a delta function, and the Langevin 
equation takes on the more familiar form 



p(t) = -V'(x)-X P (t)+F N (t), 



(9) 



where the noise is 'white' due to the sharpness of 
the memory kernel, and it is Gaussian thanks to the 
quadratic nature of Hb at h in Eq. ([5]). Here, the damping 
coefficient is A = 37T7 2 /2o;f,, where we set jj — > j/VN 
when taking the limit of a large number of oscillators. 
The fluctuation-dissipation relation ([7]) now becomes 



(F N (t)F N (t')} = 2Xk B TS(t - t'). 



(10) 



It is important to point out here that the simplified 
derivation given above can be considerably sharpened: 
The system trajectories can be rigorously shown to con- 
verge to the solutions of a stochastic problem both in the 
weak [27j and strong sense [Uj]. 

Returning to the case of an arbitrary nonlinear cou- 
pling specified by aj (x) , the above analysis goes through 
essentially unchanged, but with a more complicated 
memory kernel associated with multiplicative noise (al- 
beit, still white and Gaussian in the case of the De- 
bye spectrum) that continues to satisfy the fluctuation- 
dissipation theorem. The presence of multiplicative noise 
can cause qualitatively new dynamical effects because 
the noise amplitude depends on the system variables. 
Such effects include modifications of the equilibration 
rate 29, 30] and the existence of long-time tails in trans- 
port theory [3l|. The basic procedure described in this 
paper can be extended to the case of multiplicative noise 
as long as the system is being analyzed in the asymptotic 
late-time limit, i.e., on timescales much longer than the 
relaxation time. 

Although this class of models is relatively simple, it 
can be extended in interesting directions by changing the 
system potential or by manipulating the spectral distri- 
bution of bath oscillators. Examples of such extensions 
include studies of escape problems and tests of transition 
state theory [32J, |33| and Hamiltonian models leading to 
fractional kinetics [341 ]. 

In the models discussed above, the fluctuation- 
dissipation theorem follows as a consequence of how we 
chose the initial condition for the bath oscillators. This 
choice corresponds to running many copies of the sys- 
tem drawn from some initial distribution but, in which, 
for each realization of the initial condition, the oscilla- 
tor bath is in thermal equilbrium with respect to x(0). 
The system following the Langevin equation ([9]) will be 
driven at late times to the thermal equilbrium distri- 
bution f eq ~ exp (— j3H sys ), where H sys corresponds to 
the first two terms of the full Hamiltonian H, as speci- 
fied in Eq. ([TJ. (This result can be most easily derived 
by considering the associated Fokker-Planck equation for 
the phase space distribution (35j.) Consequently, time- 
averaged quantities exist (f T (x,p) = 1/r L T f(x,p;t)dt), 
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and are stable in the limit r — > co. We note that we are 
explicitly not considering systems with an external time- 
drive in which case there is, in principle, no equilibrium 
state. 

Note also that the Langevin equation derived here is 
inherently second-order in time (or, more generally, an 
even number of first-order equations). In the limit of 
strong coupling (large A), the velocity can be eliminated 
as a 'fast' variable and, in leading approximation, a first- 
order stochastic equation may be derived [36| . This limit 
is singular, however, and care must be taken in applying 
it in different situations. 

Finally, we turn to a discussion of how to define LEs 
for the system considered here. In principle, there is 
no problem, since given the full Hamiltonian and pre- 
scribed initial conditions, we can consider a small per- 
turbation of the initial conditions around some fiducial 
trajectory of the (full) coupled system. The summary of 
this procedure is as follows. For a 2n-dimensional dy- 
namical system governed by a set of evolution equations, 
dz/dt = F(z,t), where z = (z 1 ,z 2 ,--- , Z2 n ) T (similarly 
for F), consider (i) a fiducial trajectory, zo(t), (ii) define 
deviations from it via Z = z — zq, and (iii) linearize the 
original set of equations, yielding, 



dZ 



(11) 



where VJ 7 is the 2n x 2n Jacobian matrix. The tan- 
gent map Q(zq(£), t) is found by integrating the linearized 
equations along the fiducial trajectory; Q(zo(t), t) evolves 
the initial variables Zj„ via Z(i) = Q(i)Z, n . Define the 
2n x 2n matrix C as C — lim t _ >00 (QQ) 1 / 2t , where Q is 
the matrix transpose of Q. The LEs are then given by 
the logarithm of the eigenvalues of C. 

If we are going to view the oscillator variables in a sta- 
tistical sense, however, then we are interested only in the 
Lyapunov spectrum, and in particular the maximal LE, 
of the system variable (x,p) given an ensemble of initial 
conditions for the oscillator variables (we will throughout 
this paper refer to the maximal LE simply as the LE). 
Note that because the system evolution is actively cou- 
pled to the environment variables, for each realization of 
a set of oscillator initial conditions, the system trajectory 
will itself be different. Moreover, as given explicitly in the 
definition of the noise term Eq. ((4]) , any perturbations in 
the initial condition, x(0), as required for defining the as- 
sociated LE, would automatically change the realization 
of the noise force. This is an expected consequence of 
any systematic procedure as applied to a coupled Hamil- 
tonian system. In our independent oscillator model, the 
noise is therefore a particularly simple case of internal 
noise. 



III. SYSTEMS WITH EXTERNAL NOISE 

We first consider the case of systems subjected to ex- 
ternal noise. In this case, one assumes that the noise real- 



izations are completely independent of the initial condi- 
tions of the system variables. This would be the straight- 
forward interpretation of Eqs. © and (|TU)) if we began 
our analysis with these two equations and the actual na- 
ture of their derivation was not specified. We will con- 
sider internal noise in the next section. 

We consider an ro-dimensional system in coordinate 
space, with the system trajectory writen as x(i) = 
{x\ (t), . . . , x n (t)) T . The (Gaussian, additive white noise) 
Langevin equation we consider here is essentially Eq. @ 
written in a slightly generalized form, 



(12) 



x(i) + 7 x(i) = -VE/(x(t)) + WdW ext (t) 



where dW ex t(t) is the external noise term, with nor- 
malization set by (dW ex t) 2 — dt, U(x(t)) the poten- 
tial, and T> an n x n diagonal matrix, with the fcth 
diagonal entry, denoted Dk, being the noise intensity 
along Xk. Furthermore, 7 is the damping coefficient 
(7 > 0), a time-independent scalar. Let Xo(t) be the 
fiducial trajectory, and write x(i) = x (<) + A(i), where 
A(i) = (Ai(£), . . . , A n (t)) T . Upon linearization, 



A(t)+ 7 A(*)=-^(t)-A(t) > 



(13) 



where A(t) = (d Xi . Xj U(xo(t))), the Jacobian of 
VC/(x (i)). Notice that the noise term has disappeared 
in the linearized equation as we are considering it to be 
external. This means that any result we obtain will for- 
mally resemble that of the noise-free system; the only 
difference is that the noise may alter the fiducial trajec- 
tory Xo(i) and hence the time average of quantities that 
depend on it. 
Now let 

z(<) = A(t)e^ 2 , (14) 
and substitute into the linearized equation ([13)) . to yield 



z(t) - B(t) ■ z(t) = 0, where B(t) = - A(t). (15) 



Using a more canonical notation, 

vi(t)=z(t), v 2 (t) = z(t), 
Eq. ffS] can be written as 



(16) 



^ -mm h (t) ) 

v 2 (t)J - M{t) lv 2 (t)J' 



where M{t) 



( 7 
W) 



(17) 



Notice here A4 is a 2n x 2n matrix. Since both Vi(t) 
and v 2 (£) are n-dimensional column vectors, our above 
matrix equation is in fact a system of 2n equations. Its 
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formal solution is given by 
'vi(*) 



V|,/ ^ - (z + ^M{t x )dt x 



t r t 



o Jo 



M(t 1 )M(t 2 )dt 2 dt 1 



vi(0) 
v a (0) 



C(i)v(0), 



(18) 



where Q(t) = Te M ^\ the time-ordered exponential of 
yVt(t), and v(t) = (vi(t), v 2 (i)) T . 

Because long-time averages exist as stated in Sec- 
tion|TTl we can write M. (t) = VW+.Fm^) where each entry 
of J-M(i) oscillates around zero. Denoting Q(t) = Te M , 
our aim is now to show that, as far as computing the 
maximal LE is concerned, we can ignore the contribution 
F M {t) and be able to substitute Q(t) for Q(t) in Eq. (H"8l) . 
To justify such a substitution, we first use Eqs. (fl4| and 
(jl6]l to write Eq. $M as 



e-^/ 2 Q(t)v(0) 



A(t) 
A(t) + ?A(i) 



e-T'/ 2 Q(t)^(t)v(0) (19) 



where we define 72.(t) via Q(i)~ 1 Q(t) = Tlif) (we assume 
Q(t) is invertible). Every entry in lZ(t) grows slower than 
a linear exponential; to see this, note that 



n{t) = e(*) _1 e(t) 

= T e F M {t)+HOT{M,F M {t)) 



(20) 



where the terms designated as HOT are given by the 
Campbell-Baker-Hausdorff series. Since M. is a bounded 
constant and J-m(£) is a bounded oscillating function, if 
we consider the RHS of the above equation as a matrix, 
then every entry in the matrix grows slower than a linear 
exponential. 

Without loss of generality, let |Aj (t)| be the compo- 
nent of A(i) with the largest exponential dependence, 
and let Qi j Rj k be the entry in Q(t)1Z(t) with the 
largest exponential dependence. Then the maximal LE 
of the system is given by 

lim ilogA io (t) = lim ilog V Q toJ R ]k v k (0)e~^ 2 

t-¥O0 t t->00 t \ * ' / 

\ ^ / 

1 7 
= lim -log(Qi ojo Rj k {t)v ko (0)) - ~z 

t— >oo % Z 

= I™ -log(Q io j v ko (0)) 

t— foo t 

1 7 
+ lim -logi? iofco (t) - - 

t— >oo t Z 

1 - 7 
= lim - logCQ^^Ufc^O)) - - 

t— >oo t 2 

= lim hog(Q iojo v jo (0)) ~ I (21) 



where in the second-to-last line we used the fact Rijif) 
grows slower than a linear exponential, and hence 
lim t _ >00 (l/i)log/ii 0i7 - (t) = limt^oo l/i e(i) = 0, where 
e(t) > 0. In the last line we used the fact «fc o (0) is just 
a constant term and hence we can simply replace it with 
the constant term Vj (0) without affecting the exponen- 
tial behavior. Furthermore, since Q(t) = Te M — e Mt , 
Q{t) is a linear exponential of t. Thus, as Qi j Rj k 
is the term in Q(t)7Z(t) with the largest exponential de- 
pendence, and all the entries of lZ(t) grow slower than a 
linear exponential, Qi j must be the term in Q(t) with 
the largest exponential dependence. Therefore, the final 
line in the expression above is just the LE calculated had 
we replaced Q(t) with Q(t). 

Using the above arguments, we can substitute Q(t) 
as Q(t) without affecting the LE. Hence we may write 
Eq. as 



vi (t) 
v 2 (*) 



Te 



M 



vi (0) 
v 2 (0) 



(22) 



Furthermore, since Te 
have 



M — e Mt as M. is constant, we 



vi(t) 
v 2 (t) 



exp 



q z 

B 



vi(0) 
v 2 (0) 



(23) 



Direct expansion of the matrix exponential yields 



exp 



q i 

B 



= / cosh(VBt) VB sinh(VBt) 
I VIsinh(V3t) cosh(VBt) 



(24) 

where V~B is the matrix square root of B. Substituting 
Eqs. (HU and ([TBJ into Eq. (J23]) and using Eq. we 
get 



A(t) - cosh(V6<) 



,-7*/2 



Vl(0) 



+ V B sinh(VSt)e- 7f ^v 2 (0). (25) 

To calculate Vo, note that A, given in Eq. (jT3")) . is a 
real symmetrical matrix, so S (and hence B), defined in 
Eq. (|15l) . is also a real symmetrical matrix and is hence 
diagonalizable with real eigenvalues. Then we can write 
B = VDV^ 1 , where I? is a diagonal matrix. It follows 
that VB = Vy/VV^ 1 , and \fT> is just the square root 
of the entries along the diagonal of T>. Thus, we see 
from Eq. (|2~5|) that if we want A(t) to have exponential 

divergence, we require e ±v ^' to have an exponential with 
power greater than 7/2 as one of its terms. In particular, 



±VEt _ giVx/DfV- 1 _ y e ±%/Ciy-l 



(26) 



so we would like one of the diagonal terms of VD, i.e. an 
eigenvalue of VB, to be larger than 7/2 in magnitude. 
Hence, B must have an eigenvalue greater than 7 2 /4 for 
the LE to be positive. 

By definition, B = 7 2 /4 — A, so if As is an eigenvalue 
of B, then = 7 2 /4 — Xb is an eigenvalue of A. Since 
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we need Xb > 7 2 /4 for the LE to be positive, this means 
we need < 0. However, the system is in thermal 
equilibrium, so 

dl Xi U(M*)) = C jjl Xi U(x)e- u ^ D * dV 

= C f d Xz U{x)e~ u W D * da 
Js 

+ £ f d Xl U( X fe- u ^/ D >dV, (27) 

where C is the normalization constant, S the (fluctu- 
ating) constant-temperature hypersurface, and £ the re- 
gion enclosed by S. Because we assumed B, and hence A, 
is constant, the LHS of Eq. (f27|) is by definition just An. 
Moreover, Xi is bounded by S, so increasing Xi for any i 
will lead to higher potential energy, which means d Xi U{x) 
is nonnegative on S. It follows the RHS of Eq. (|27|) is 
nonnegative, so An > 0. Consequently, all the diagonal 
entries of A must be positive, and in particular tr.4 > 0. 

It is now clear why the LE is always nonpositive in the 
1-dimensional case, even with an external noise drive. In 
the 1-dimensional case, A is a scalar, so it is trivially 
true that A = tr A = Xa- However, as stated above, in 
order for the LE to be positive, we need Xa < 0, while 
from Eq. (|27|) . tr A > 0. Hence, there are simply not 
enough degrees of freedom in one dimension to satisfy 
these two conditions simultaneously and produce chaos. 
Of course, this result is not entirely surprising since it is 
well known that 1-dimensional Hamiltonian systems are 
not chaotic (although driven ones can be). Nonetheless, 
the calculation shows that in 1-dimensional systems with 
noise-induced chaos, either the noise source is not exter- 
nal, or the noise is such that the assumptions we made 
no longer hold, e.g., lack of a fluctuation-dissipation re- 
lation. 

On the other hand, let us consider a 2-dimensional 
system. Then the eigenvalues of A are 

^ = tiA± V(tr.4) 2 -4det^ ^ 

In order to have a positive LE, one of the solutions must 
be negative. This means it is necessary for either tr A < 
or det A < 0. We cannot have tr A < by Eq. (J2ZD, but 
we can choose det A < 0. A simple numerical illustration 
of this is 

(29) 

With the choice 7 = 2, indeed one of the exponents in 
Eq. (|25[) is positive. We would like to emphasize though 
that the entries in the above matrix A are not the ac- 
tual second derivatives of the potential; rather, they are 
the time-averaged values. If we naively treat the en- 
tries of A as just the second derivatives of C/(x (t)), 
then the potential is the quadratic potential U(xi,X2) = 
(l/2)xi + (1/2):e2 + 2xiX2, which is unbounded below 



along the line x\ = —xi and thus obviously chaotic (in 
an unbounded sense). However, if the entries in A are 
the time-averaged values of d Xi:Xj U(x (t)) for a particu- 
lar unknown bounded potential, then the LE is positive 
for a system with weak noise. 

We conclude this section with an explicit expression 
for the LE. We showed that the solution to the linearized 
version of the Langevin equation is given by Eq. (1251) : 

A(t) ~ cosh(\/m)e" 7t/2 vi(0) 

+ V / ^ 1 sinh(v / ^)e" 7t/2 v 2 (0). (30) 

where_vi(0) = A(0) and v 2 (0) = A(0) + ( 7 /2)A(0), 
and B is given by Eq. (fT5j). Note every eigenvalue 
of B is real as it's a real symmetric matrix, so every 
eigenvalue of VB is purely real or purely imaginary. 
Let X^g + be the maximum real eigenvalue of V~B, and 
A v tq_ be the minimum real eigenvalue of V~B, and let 
Xmax = max (|A v ^g + |, |A v ^g_|). Then we have the follow- 
ing cases: 

1. If X max > 7 /2, then A(t) ~ ^^-112)1 for large 
t, so the LE is positive. 

2. If X max = 7/2, then A(i) ~ K for some constant 
K, so the LE is 0. 

3. If X max < 7/2 or all the eigenvalues are imaginary, 
then A(t) - e (Amt " _7/2) * for large t, so the LE is 
negative. 

As we can see from above, the damping coefficient is 
"suppressing" chaos, since if we take 7 — > 0, then a sys- 
tem with a very small positive X max is chaotic. But if 
we slightly increase 7 and presume the long time aver- 
age A(t), and hence X max is not affected, then the LE is 
smaller in this new system. We remark that for exter- 
nal noises, the noise term is decoupled from the damping 
mechanism. Therefore, the damping mechanism is asso- 
ciated just with the system, so the system is Hamiltonian 
only if the damping coefficient 7 is zero. In this case, the 
third possibility given above is impossible as X max > 
by construction. As our Hamilitonian system remains 
Hamilitonian after coupling it to a Hamilitonian heat 
bath, this shows that our conclusion is consistent with 
the fact that for Hamilitonian systems, there arc equal 
number of positive and negative LEs in the spectrum, so 
the maximal LE is always nonnegative, i.e. only the first 
and second options above are valid. 



IV. SYSTEMS WITH INTERNAL NOISE 

We now proceed to examine internal noise. As before, 
the Langevin equation is 

x(i) + 7 x(i) = -VC/(x(i)) + VvdW mt (t), (31) 
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where the only difference from Eq. (TT2|) is the fact that 
dWi n t(t) is an additive internal noise term. (In principle, 
the coupling can be more complicated, but we ignore 
that here.) The noise term arises from coupling the sys- 
tem self-consistently to an external dynamic structure. 
As discussed in the Introduction, these degrees of free- 
dom could be a dynamical model for a heat bath, such 
as a collection of harmonic oscillators, or more generally, 
'fast' modes in a system coupled to slower modes of phys- 
ical interest. In any case, let us suppose there are m such 
outside structures. Then we can label the position and 
momentum variables of these outside structures as q(f ) = 
(qi(t), . . . ,q m {t)) T and p{t) = (pi(i),--- ,p m (i)) T , re- 
spectively. Note that each and Pj is an n-dimensional 
vector representing the n-dimensional space the system 
is in. As always, we remember that x is an n-dimensional 
column vector, 7 is a scalar, and T> is an n x n diagonal 
matrix, with the kth diagonal entry, denoted Dk, being 
the noise intensity along Xk- 

We now emphasize that since we have internal noise, 
the term dWi nt (t) is inherently dependent on both the 
system initial conditions, x(0) and x(0), and the 'noise' 
initial conditions, q(0) and p(0). This time, when we lin- 
earize the equation, we must decide to either only perturb 
the system initial conditions or those for both the system 
and noise. But perturbing the system initial conditions is 
the same as perturbing both the system and the noise as 
they are coupled, therefore, it doesn't matter which one 
we choose. This does not mean that coupling a system 
to a noise source cannot change the system's Lyapunov 
exponent. Rather, we are stating that for a system al- 
ready coupled to an internal noise source, the exponent 
obtained by perturbing the system initial conditions is 
the same as that obtained by perturbing the initial con- 
ditions of both the system and the noise. For the rest of 
the section we will perturb initial conditions for both the 
system and noise during the linearization process. 

Next, we note that here 'noise' is a term we use for 
a complicated underlying process with unknown exact 
behavior. Hence, for a particular internal Gaussian white 
noise realization dWi n t (t) , we can write 

VvdW mt (t) = ^h i (p(0),q(0),x(0),x(0),*), (32) 

i 

where h^'s are unknown n-dimensional column vectors 
involving the initial conditions, such that when averaged 
over noise realizations (denoted as (•••)«), 

{^fDidW int {t)) n = 0, 
(^D~dW tn t(t)^/D~dW mt {t')) n = ^D~D~8(t-t') 

(33) 

for all Now when we linearize Eq. pip , we perturb 
the initial values x(0), x(0), q(0), and p(0). Denote the 
perturbed variables A(i), A(£), A 9 (i), and A p (t), re- 
spectively, and let xo(t) be the fiducial trajectory. Hence, 
the linearized equation is 

A(i)+A(t) = -A(t)A(t)+S(VvdW mt (t)), (34) 



where A(t) = (d XiX - U(x.o(t))), the Jacobian of 
VZ7(x (i)), and 

5(VVdW int (t))=Y,ni(A) (35) 

i 

is the perturbation of the noise term. Here, A = (I,t), 
where I denotes the initial conditions for the system and 
the noise such as A p (0) and p(0). Note that every term 
in 11^ must, to first order (i.e. we Taylor expand func- 
tions to first order), be proportional to one of the per- 
turbed initial conditions, as all the terms not propor- 
tional to an initial condition have canceled out from the 
linearization. Furthermore, note that once we linearized 
the equation, we no longer have a stochastic ODE. The 
reason is because our perturbations are exact, so even if 
in Eq. (j3"Tj) . we only knew the distribution of q(0) and 
p(0), in Eq. (|34)) . we chose exact perturbations of the ini- 
tial conditions. This means that 5(vDdWi n t(t)) is not 
white noise! 

Now, we don't actually know the exact forms of the 
Ilj's, and without knowledge of these functions, we 
cannot solve the linearized ODE Eq. (p4|) . Therefore, 
rather than letting the perturbations be exact, let us 
allow the perturbations to be a distribution such that 
8{^/T> dWi n t(t)) is Gaussian white noise when averaged 
over all possible perturbations. In other words, we choose 
the distribution to satisfy for all i,j,l,m 

(IIa(A))p = 0, (36) 
5^<na(A)n Jm (A))p = y/KiK m S{t-t'), (37) 

where (• • • ) p denotes averaging over perturbations (so we 
can pull x(0), x(0), q(0) and p(0) out as they don't de- 
pend on noise perturbations). Here is the Ith com- 
ponent of 11^, and K, is the diagonal matrix analogous 
to T>. While the above two conditions can certainly be 
satisfied if the coupling is linear (so h — s- II by chang- 
ing x(0), x(0), q(0), p(0) to their perturbed quantities) 
by virtue of Eq. (j3"3")l , it is unclear as to whether the above 
two conditions can be satisfied for all general couplings 
between system and noise. 

We should point out that it is fine to take the per- 
turbations along some directions to be zero, since per- 
turbing any one initial condition causes the trajectory 
to be perturbed in all dimensions, as long as the vari- 
ables are coupled. We will henceforth work under the 
assumption that Eqs. (|36l) and (13"T|) can be satisfied in 
the system we're working in. In particular, note that 
K -> as A(0), A(0), A 9 (0), A p (0) -> by Eq. ([37]) and 
the fact that every term in 11^ is proportional to one of 
the perturbed initial conditions by the paragraph under 
Eq. (j3"5)l . Thus, the distribution of the perturbations can 
be thought of as a white noise with infinitesimal intensity 
matrix K,. This means that when studying systems with 
internal noise, when we perturb the fiducial trajectory, 
the noise term in it is not simply a new noise realization 
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of intensity y/T>, as done in Ref. [2l|; rather, it has an 
infinitesimal intensity. 

By viewing the perturbations as distributions, we can 
examine the mean and variance of the divergence be- 
havior of perturbed trajectories due to slightly different 
perturbations. Note that for calculating the LE of a sys- 
tem, we don't care what the perturbation is, as long as 
it's infinitesimal and not specified only in one direction 
(the latter requirement makes sure we have a generic per- 
turbation so the direction of the maximum exponent is 
perturbed); this is Osledec's Theorem. We emphasize 
that there is nothing special about viewing the initial 
perturbation as a distribution. We could have done the 
same in a noise-free system or a system with external 
noise. However, in both of these cases, to do so wouldn't 
change anything, as the linearized equation is Eq. (TH 



A(t)+ 1 A(t) = -A(t)A(t), 



(38) 



where the initial conditions do not appear at all. It is 
true that the solution contains the initial conditions, so 
treating the initial perturbation as a distribution will now 
cause the solution to be a distribution; nonetheless, the 
exponential in the solution, and hence the LE, remains 
the same. Viewing the initial conditions as a distribution 
only helps if our system has internal noise, in which case 
we do not know all the terms in the linearized equation 
Eq. (|3"4"|) and hence cannot evaluate it. Yet, because the 
initial perturbation is generic, letting it be a distribu- 
tion does not change the LE of our system. Therefore, 
by examining the exponential behavior of the mean and 
standard deviation of each variable Xi , we can obtain the 
exact LE of the system with internal noise. The reason 
we cannot obtain the exponent through only the mean 
is because the mean divergence is effectively obtained by 
choosing a particular initial perturbation, which may not 
have been a generic perturbation and hence may not give 
the maximum exponent; the standard deviation, how- 
ever, takes into account all generic perturbations. 

From our arguments above, the linearized equation for 
our system with internal noise is 



A(t) + 7 A(i) = -A(t)A{t) + V/C dW(t), (39) 

where A(t) = (d XiX U(xo(t))) as before and dW(t) is our 
perturbation distribution, which is Gaussian white noise. 
Again let 



z(t) = A(t)eT'/ 2 , 
so substitution yields 

z(i) - B(t)z(t) = VlCdW(t)e lt/2 , 
where B(t) = - A{t). 

As before, let 

vi(i)=z(i), v 2 (t)=i(t), 



(40) 



(41) 



(42) 



and denote v(t) = (v x (i), v 2 (i)) T . The n our second order 
ODE becomes 



d_ f Vl (t) 
dt 1 v 2 (t) 



M(t) 



vi(t) 
v 2 (t) 





KdW{t)e^/ 2 y 
T(t), (43) 



where 



M(t) 



(01 

\B(t) 



(44) 



We keep in mind that Ai(t) is in fact a 2n x 2n matrix, 
and T(t) is a 2n-dimensional column vector. As T(i) is 
Gaussian white noise, for all 

Fi{t)) p = 0, (PiWTjtf)),, = UyitJWt - t'), (45) 

where 



U(t,t') 
H(t,f) 





o s(t,t')y 



VKTK^ 



o7 (t+t')/2 



(46) 



Here, U is a 2n x 2n matrix, with C/y(t, t 1 ) = Uji(t, t'), so 
all the conditions for a multivariate Gaussian white noise 
are satisfied pjjj . 

We now invoke the assumption that the trajectories 
are sampling an equilibrum distribution over long times, 
so that B(t) = B and thus M(t) = A4 are constants. 
To solve Eq. (|43p . we first determine the homogeneous 
solution v h (t): 



v h (t)-Mv h (t) = 



dt 
v' l (i) 



*v*(0). 



(47) 



We have already expanded this solution in the previous 
section. Next, we want a particular solution for the in- 
homogeneous case of Eq. (|43|) . We will follow the steps 
given in Ref. [35[ and write 



Q{t) = e mt . (48) 
Suppose v™- h (t) = J2j Gij(t)cj(t) for some Cj's. Then 



vl nh (t) = E + G l3 {t)c 3 {t) 



(49) 



Furthermore, by Eq. ([43|) 

v? h (t)=r i (t) + J2M ij v™ h (t) 

3 

= T i (t)+^M ij G jk (t)c k (t) 

3 

= r i (t) + ^G ij (t)c j (i), 



(50) 
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where we used Eq. (|48[) to obtain the last equality. Equat- 
ing Eqs. flU]) and (JSUJ) yields 



5^G«(t)c,-(i) = r < (i). 



In matrix representation, 

g(t)c(t) = r(t). 

Thus, 



(51) 



(52) 



t 



G{t)t{t')dt' = / gwg-'wgwcWdt' 





/ 0(t)0- 1 (t')r(t / )dt / . (53) 
Jo 



The LHS is just v m,l (t) = 0(t)c(f). Recalling Eq. (|38]). 
the complete solution to Eq. (J43J) is 



v(t) = v h (t) +v inh {t) 

= e Mt v(0) + [ e^-^T^dt'. (54) 



Taking the mean of both sides and applying Eq. (|45 
yields 



(v(t)) p = e^*<v(0)) I 



(55) 



so the mean of v(t) behaves in exactly the same way 
as in the case for systems with external noise (c.f. 
Eq. (|22])). Furthermore, we want to calculate the vari- 
ance of Eq. (|5"4"|) . Multiplying the ith and jth coordinate 
of v(i) using Eq. ([54]) . where i,j < 2n, taking the aver- 
age (see Ref. [35j), and applying Eq. (|4"5"j) . we obtain the 
variance 

a 1J (v(t))=G !3 (t)(7 1J (v(0)) 

t r t 



u . JO JO 



x (r fc (ti)r s (^)) p <d4 

Gy (iK-(v(0)) 



E / [ G ik (t-t[)G ja (t-t' 2 ) 

k,a J ° J ° 



= G ij (t)a ij (v(0)) 
+ E / G ik (t-t')G js (t-t')U ks {t',t')dt'. 

k.s J ° 

(56) 

Hence, the variance of the ith variable is 
o-«(v(t)) - Gao-iiCvfO)) 

+ E / G ik (t-t')G is (t-t')U ks (t',t')dt'. 

k,s J ° 

(57) 



Now, by definition Eq. (|48 



S(t-t') 



/\ _ p M(t-t') _ 



exp 



I 
B 



(t-f) 



coshVS(i-i') y/B 1 sxahy/B{t-t')\ 
Bsmh^fB(t-t') coshVB(«-*') / 

(58) 

This is in fact a 2n x 2n matrix, so Gn for example does 
not refer to cosh\/S(f — i')> but to the upper-left entry 
of coshv / S(i - t'). From Eqs. (j40j) and (|i2]). we have 
A(i) = e~ 7 */ 2 vi(£). Let us denote vi$ the ith coordinate 
of V\(t). Since this is also the ith coordinate of v(t) as 
v(£) = (vi(i), V2(i)) T , it follows that for i < n, 



a lI (A(t)) = ((A 4 (i)-A l (i)) 2 ) p 



(e^'KW-^fi)) 2 



e^V^t)). 



(59) 



It follows for i < n, the variance of the ith component of 
A(i) is 

ff«(A(t)) = G il ^(v(0))e^ t 



-7t' 



E / G ik (t-t')G is (t-t')U ks (t',t')dt', 



(60) 



where Q{t-t') is determined by Eq. flSHJl and £') is 
determined by Eq. (|46|) . The standard deviation of the 
ith component of A is thus 



sd«(A(i)) = [G ll( r Il (v(0))e-' yt 



E< 



-7* 



G ik (t-t')G is (t-t')U ks (t',t')dt' 



1/2 



(61) 



Let us use our previous notation, where ^^/b + and A 

are the maximum and minimum real eigenvalues of VB, 
respectively, and \ max = max(|A A /^ + |, |A^g_|). Recall 
from Eq. ([26]) that 



±VBt _ +vVvtv- 



Ve ±Vvt v -i_ 



(62) 



Suppose X m ax is the jth entry of the diagonal matrix 
\fT>. Then the ith row of giv^y- 1 are all entries in- 
volving e Amax , where we choose the sign of \fV so X max is 
nonnegative. Thus, every entry in e ±v ^* = Ve ±v ^ 4 V _1 
involves e Amax . Cancellation may occur for some terms if 
\J~B~ has multiple eigenvalues \ m ax , but we do not expect 
cancellation to occur for all terms. Then for large t, 



(63) 
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for some i, j. Hence, at least one term in the sum on the 
RHS of Eq. (joTj) is proportional to 

e -7* r e 2A m „ (t-f) e yt> dt , 

Jo 

= e (2A mo ,- 7 )t f & h-2X max )t' dt > 

Jo 

= e (2A max - 7 )t , 1 (" e (7-2A max )t _ j\ 

7 — 2A ma2; V / 
~ |e< 2A ""» " 7)t - 1|, (64) 

where we used Eq. (|46|) to conclude f/y ~ e 7 * . Hence, 
this term has a larger exponential than the first term on 
the RHS of Eq. (foTj) and dominates the expression. It 
follows that 

8d a (A(t))~^| e (2A™..-7)t_i|. (65) 

Since the mean of A(t) is the RHS of Eq. fl^SJ) with dif- 
ferent initial conditions, when X max > 7/2, the mean 
and standard deviation of A have the same exponential 
behavior, while if X ma x < 7/2 or X max does not exist 
(the eigenvalues are imaginary) , the constant term in the 
standard deviation dominates. As in the external noise 
case, every eigenvalue of V6 is either purely real or purely 
imaginary, and we then have the following cases: 

1. If X m ax > 7/2, then sd«(A(t)) ~ e (^*-7/2)t for 
large t, so the LE is positive. 

2. If Xmax = 7/2, then sd«(A(i)) ~ K for some con- 
stant K, so the LE is 0. 

3. If Xmax < 7/2, then sd^(A(£)) ~ K for large t for 
some constant K, so the LE is 0. 

4. If the eigenvalue(s) of \[~B are all imaginary, then 
sdiiA(£) is sinusoidal, so the LE is 0. 

This strongly resembles the cases in the previous section, 
when we examined systems with external noise. How- 
ever, we do note that the internal noise now prevents ex- 
ponential convergence from occurring. Intuitively, this 
makes perfect sense, since while the damping term 7 
causes the phase space trajectories to converge, the noise 
contributes energy into the system and hence counteracts 
the damping. Clearly, since we are assuming the noise is 
weak, it cannot have an impact on the chaotic behavior 
of systems with positive LEs. However, if the system by 
itself has a negative exponent, then the internal noise will 
begin to dominate the separation of nearby trajectories 
after a long time, as the noise terms stay constant while 
the system terms become "weaker" due to damping. We 
would like to point out, however, that even with internal 
noise, we cannot have 1-dimensional chaos. This conclu- 
sion can be easily seen by the same argument used for 
the external noise case. 



V. CONCLUSION 

Our primary purpose here was to understand the basic 
issues in defining the LE for a noisy system, in a situation 
where a controlled analysis is possible. To do this we first 
provided a context where 'noise' is more or less clearly 
defined, by exploiting the oscillator heat bath paradigm. 
Although this paradigm is by no means completely gen- 
eral, it serves as an illustrative example for what, in prin- 
ciple, needs to be worked out in more complex situations. 
By using this model, we can define the LE in an uncon- 
troversial way, by first linearizing around the dynamical 
trajectory, and only later considering what terms need to 
be thought of as noise, and under what circumstances. 

We distinguished in our work between external and in- 
ternal noise to avoid dynamical inconsistencies (see, e.g., 
the discussion in Ref. [3j). By setting up the the defini- 
tion of noise following the oscillator heat bath approach, 
we first considered the case of external noise as an uncon- 
trolled limit of the model. Even in this case, the second- 
order nature of the equations of motion and the existence 
of a fluctuation-dissipation theorem helps us to arrive at 
reasonable conclusions about the behavior of the LEs - 
no chaos for one-dimensional systems, but the possibility 
remaining open in higher dimensions. 

Turning next to the case of internal noise perturba- 
tions, we noted that the noise forcing terms in this case 
cannot be set to zero after linearization, because of the 
self-consistency requirement. A residual piece remains, 
proportional to a set of (unknown) initial conditions for 
the bath. In the case of a linear system-bath coupling 
we can proceed by constructing a particular distribution 
of initial conditions such that when averaged over it, the 
perturbations arising from the initial conditions do have 
the properties of Gaussian white noise, characterized by 
an infinitesimal noise intensity matrix /C. So, when the 
fiducial trajectory is perturbed, it is not perturbed by the 
original noise strength ^/V, which can be much larger. 
The late-time limit of the standard deviation of the per- 
turbed trajectory ensemble can be used to find the max- 
imal LE, using once again the fact that the trajectories 
are exploring a canonical distribution. 

Although our analysis helped shed some light on the 
relationship between chaos and weak noise, it is only a 
small step towards understanding this complex yet fas- 
cinating relationship. For instance, our treatment was 
restricted to the case of thermal equilibrium, and we did 
not consider systems driven by external time-dependent 
forces. In principle, explicit time-dependences can be in- 
troduced into the oscillator models [33] , but the possible 
lack of a stable late-time distribution will likely restrict 
the statements that can be made on an analytical basis. 

Furthermore, our analysis also raises some possible im- 
plications on how noise induced chaos may arise. Noise- 
induced chaos is chaotic behavior in a system that arises 
only when the system is coupled to noise. From our re- 
marks in the last paragraph of Section IIV| there cannot 
be noise induced chaos in 1-dimensional ergodic (equi- 
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lbrium) systems, so let us consider the case of higher- 
dimensions. From Eq. (fT5]) and taking B[t) = B con- 
stant, we see that Bn = 7 2 /4 — An. But we also know 
from Eq. that 

A u = C [ d Xi U(x)e- u W Di da 
Js 

+ 7T I d Xz U{xfe- u{s)/D ' dV 7 (66) 

so Bii, and hence B, is dependent on noise intensity. Be- 
cause the eigenvalues of \f~B determine the LE of the 
system, this means if B changes, the LE will potentially 
also change. In particular, let us suppose our system 
has a X m ax slightly less than 7/2. Since our analysis of 
systems with external noise formally resembles that of 
noise-free systems as the noise term disappears via lin- 
earization (see Eq. (|13p and the paragraph below), this 
means if X ma x is slightly less than 7/2, then our system 
has a negative LE. Now, let us couple this system to ei- 



ther external or internal noise. If the noise intensity Di 
is small enough such that the system coupled to the noise 
is still approximately ergodic, but large enough to shift 
the eigenspectrum of \/~B such that X ma x is now slightly 
greater than 7/2, then our system now has a positive LE, 
resulting in noise-induced chaos. However, how to couple 
the noise so that such a shift in the eigenspectrum occurs 
is still an open question, and one that is worth exploring. 
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